Admissibility of Memorization Learning with Respect to Projection Learning in the Presence of Noise
نویسندگان
چکیده
In the training of neural networks using the error-backpropagation(BP) algorithm, overlearning phenomenon has been observed. In the previous works we showed how over-learning can be viewed as being the result of using the BP criterion as a substitute for some true criterion. There, the concept of admissibility was introduced and discussed conditions for a true criterion admits a substitute criterion. In this paper we provide necessary and su cient conditions for the projection learning to admit the memorization learning in the presence of noise. Based on these conditions, we devise methods for choosing training sets to prevent over-learning.
منابع مشابه
An Effective Approach for Robust Metric Learning in the Presence of Label Noise
Many algorithms in machine learning, pattern recognition, and data mining are based on a similarity/distance measure. For example, the kNN classifier and clustering algorithms such as k-means require a similarity/distance function. Also, in Content-Based Information Retrieval (CBIR) systems, we need to rank the retrieved objects based on the similarity to the query. As generic measures such as ...
متن کاملInvestigating the Effects of Rote and Contextualized Memorization on Iranian Elementary EFL Learners’ Vocabulary Development
It is obvious that vocabulary lies in the center of language learning and communication. This issue shows that vocabulary has a vital role in mastering all the skills of a language. Vocabulary Learning Strategies (VLS) facilitate the process of learning lexical items. The present study investigated the role of two specific strategy types in vocabulary learning, including rote and contextualized...
متن کاملNoise Suppression in Training Data for Improving
Multi-layer feedforward neural networks are trained using the error back-propagation(BP) algorithm. This algorithm minimizes the error between outputs of a neural network(NN) and training data. Hence, in the case of noisy training data, a trained network memorizes noisy outputs for given inputs. Such learning is called rote memorization learning(RML). In this paper we propose error correcting m...
متن کاملThe Effect of Mnemonic Key Word Method on Vocabulary Learning and Long Term Retention
Most of the studies on the key word method of second/foreign language vocabulary learning have been based on the evidence from laboratory experiments and have primarily involved the use of English key words to learn the vocabularies of other languages. Furthermore, comparatively quite limited number of such studies is done in authentic classroom contexts. The present study inquired into the eff...
متن کاملThe Effect of Memorization Model on Nursing Students’ Academic Achievement in Physiology Course a Study in Isfahan University of Medical Sciences
Introduction: Today's Medical education is associated with numerous complications including potential increase of data volume in clinical and theoretical learning environments. This requires for new strategies using appropriate instructional methods. This study was performed to investigate the effect of the memorization model on nursing students' academic achievement in physiology course. Meth...
متن کامل